Lumpability and Commutativity of Markov Processes
نویسنده
چکیده
We introduce the concepts of lumpability and commutativity of a continuous time discrete state space Markov process, and provide a necessary and sufficient condition for a lumpable Markov process to be commutative. Under suitable conditions we recover some of the basic quantities of the original Markov process from the jump chain of the lumped Markov process.
منابع مشابه
Analysing grouping of nucleotides in DNA sequences using lumped processes constructed from Markov chains.
The most commonly used models for analysing local dependencies in DNA sequences are (high-order) Markov chains. Incorporating knowledge relative to the possible grouping of the nucleotides enables to define dedicated sub-classes of Markov chains. The problem of formulating lumpability hypotheses for a Markov chain is therefore addressed. In the classical approach to lumpability, this problem ca...
متن کاملA necessary condition for weak lumpability in finite Markov processes
Under certain conditions, the state space of a homogeneous Markov process can be partitionned to construct an aggregated markovian process. However, the verification of these conditions requires expensive computations. In this note, we expose a necessary condition for having a markovian aggregated process. This condition is based on properties of the eigenvalues of certain submatrices of the tr...
متن کاملApplied Probability Trust (14 August 2011) RATIONAL PROCESSES RELATED TO COMMUNICATING MARKOV PROCESSES
A class of stochastic processes, denoted as marked rational arrival processes (MRAPs), is defined which is an extension of matrix exponential distributions and rational arrival processes. Continuous time Markov processes with labeled transitions are a subclass of this more general model class. New equivalence relations between processes are defined and it is shown that these equivalence relatio...
متن کاملA geometric invariant in weak lumpability of finite Markov chains
We consider weak lumpability of finite homogeneous Markov chains, that is when a lumped Markov chain with respect to a partition of the initial state space is also a homogeneous Markov chain. We show that weak lumpability is equivalent to the existence of a direct sum of polyhedral cones which is is positively invariant by the transition probability matrix of the original chain. It allows us, i...
متن کاملExact and Ordinary Lumpability in Finite Markov Chainsy
Exact and ordinary lumpability in nite Markov chains is considered. Both concepts naturally deene an aggregation of the Markov chain yielding an aggregated chain that allows the exact determination of several stationary and transient results for the original chain. We show which quantities can be determined without an error from the aggregated process and describe methods to calculate bounds on...
متن کامل